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FOREWORD 



This report covers the period 1 July to 30 November, 
1949, Its purpose is to record developments during this time, 
to inform sponsors and responsible agencies of these develop- 
ments, and to give the growing audience of people interested 
in the Instructional Film Research Program advance J information 
of research results not covered by earlier or, as yet, by final 
reports. 

The Scientific Officer of this Program as well as 
the Local Representative of the Office of Naval Research have 
approved the form of progress-reporting developed by the 
Instructional Film Research Program, This type of progress 
report has been adopted because of the widespread interest 
in the Instructional Film Research Program by people not direct- 
ly responsible for its administration. Also, this form of 
reporting was approved because of the need to give summaries 
of results before final technical reports could be prepared and 
distributed. This approval is an example of the commendable 
liberality with which the representatives of the Office of Naval 
Research are administering and supervising Contract N6onr-269, 
Task Order VII. 

Financial statements will not be given in this report. 
Fiscal analyses will be supplied to those responsible for this 
Research Program by means of a supplementary letter. It is 
believed that most of the people who read progress reports of 
Instructional Film Research Program are not interested in budgets. 

The increased demands for these progress reports 
have influenced the form in which they are. written. It is 
intended that they shall be both informative and useful. 



C. R. CARPENTER, Director 
Instructional Film Research Program 

The Pennsylvania State College 
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GENERAL STATEMENT 






The main efforts of the Staff of the Instructional 
Film Research Program for this report period have been directed 
toward the testing of experimental films with selected popu- 
lations, the production of additional series of experimental 
films, the processing of data, and the preparation and issuance 
of final technical reports* 

Test ing * The actual testing or proving of films with 
large and appropriately selected populations has been more 
extensive than for any previous report period,. 

Following preliminary tests on 434 high school stu- 
dents, the experimental films for Project Number 12 (Vincent), 
Relationship of Length and Fact Frequency to Effectiveness of 
Instruct ional Mot i on P ic tures , were tested on a potulation of 
503 Air Force recruits at the Lackland Air Base, San Antonio, 
Texas* Responsible branches and sections of the Air Force were 
most cooperative and provided very favorable and realistic 
conditions for testing the experimental versions of films deal- 
ing with Aerology* A more advanced test population was also 
needed, and the films were therefore shown to 324 College stu- 
dents who were beginning their first course in Meterology* 

Thus, a total of 1261 subjects have been employee > 

for testing the hypotheses and experimental film versions ol 
Project Number 12* Additional replications are planned* 

Project Number 22 (Neu), At tent ion - Ga in ing Devices 
in Films , was tested at the Great Lakes Naval Training Station 
with 1150 Navy recruits* With the cooperation of the Army 
Signal Corps and other Army commands, further tests were run 
on 1500 trainees at Fort Dix* Thus, for t his Project the film 
variables and versions were tested on both Navy and Army re- 
cruits until the population of 2650 as required by the experi- 
mental design was reached* 

The experimental films for Project Number 44 (Jaspen), 
Effects on Training of Exper imenta 1 Film Var iables , Study 1 1 g 
*How- It-Works Verbal izat ion . Par t ic ipa t i on and Succinct 
Treatment , were tested at the Great Lafces Naval Training Station 
on approximately 2000 recruits* 

Selected films for Project Number 32 (Nelson), 

Re lat ive Contr i but ions to Learning of Video and Aud io Elements 
in Films, were tested on 430 members of the local Penn State 
ROTC. 



In summary approximately 6300 subjects were used 
during July, August, September, October and November for the 
testing of experimental film versions* 

The preparation of tests for both experimental and 
selected films is always a difficult and time-consuming task* 
The tests for Project Number 22 on At tent ion-Ga in ing Devices 
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in Films are especially interesting in that a fair proportion 
oF the multiple-choice test items were presented uO the sub- 
jects in visual form* i 0 e 0 as drawings and outlined sketcheso 

Product ion 0 Production of experimental films has 
been accomplished on schedule® The Motion Picture and Record- 
ing Studios have cooperated fully with members of the Film 
Program’s Research Staff* and high production standards have 
been maintained.. 

In addition to completing the required film produc- 
tions for Projects 22 and 44 during July and August* production 
was begun and is well advanced on Project Number 33 (Abramson)* 
Employment of Sound F i 1ms for Restru c tur ing At t i tudes * and Pro- 
ject Number 35 (Tyo) The Effects of Authent ic Sounds in 
Instruct ional F i 1ms : _I » Learning The Stroke in Typewr i t ing 0 

For two projects* Number 32 (Nelson) (see reference 
above*) and Number Z5 (Kishler), The Effects of Prestige Factors 
on Learning and Attitude Restructur ing from SoundT i 1ms * exist- 
ing films were selected and are being usedo For Pro ject Number 
32* "Theory of Flight" and "Problems of Flight" from Encyclo- 
paedia Britannica Films were used* while "Keys of the Kingdom” 
was selected for testing in Froject Number 25® 

Processing of Data ® The statistical processing of 
the data which results from the extensive testing of large 
populations continues to require a major part of the time of 
several members of the Research. Staff e For scoring tests* a 
test-scoring machine is used on a full-time basiSo Tabulating 
and calculating services provided by the Central IBM Service 
Bureau of the College have not* as yet* proven to be entirely 
sat isf actory 0 A major part of IBM machine calculating is still 
being done at the U» So Naval Supply Depot* Mechanicsburg* 
Pennsylvania* where complete cooperation has been given in the 
form of making IBM tabulators and sorters available for use by 
qualified Instructional Film Research Program Staff memberso 

Repor ts o During the report period under review 
Progress Report No, 11-12 was printed and distributedo This 
report is generally considered to be a major contribution to 
the field of communications research. In it Drs 0 van Ormer 
and Smith reviewed the work of the Film Research Program with- 
in a carefully organized framework of modern learning theory® 

Dr, Ash completed his final technical report on Project 9* 

The Re lat ive Effectiveness oT Massed Versus Spaced Film 
Presentat ion o During this period* also* Dr. Roshal’s report 
on Project 14* The Effects of Learner Representation in Film 
Med ia ted Perceptual -Mo tor Learning * and Mr . Zuckerman’s re- 
port on Project 19* Commentary Var iat i o ns s Leve 1 of Verbali - 
zation * Personal Reference * and Phase “Relations _in Ins true tion - 
a 1 * Pi 1ms on Perceptual-Motor tasks * were carried through the 
final stages of manuscript preparation and editorial work® 



Drso Hoban and van Ormer did the major part of the 
work on the preparation of a report (which will be available 



soon) on Project Number 4, A Cr it ical Ev aluation and Summary 
of Exper imental Literature on Instruct jovial Fi lms , 

A bibliography of all reports is given at the end 
of this Progress Report, 



ORGANIZATION 



Several changes of importance were made in the organi- 
zation of the Instructional Film Research Program® The Advisory 
Committee recommended that a Director for the Program be of- 
ficially appointedo This was done by the Office of the Presi- 
dent of the Collegeo It was decided to reduce the size of the 
Advisory Committee and to define its function as being strictly 
advisory to the Dean of the School responsible for the 
Instructional Film Research Program,, It was deemed desirable 
to eliminate from the table of organization the names of con- 
sultants since they had already served their functions during 
the initial stages of the Program and since other developments 
such as the formation of a Joint Services Advisory Committee 
has made their services less necessary than formerly,. 

An Administrative Committee consisting of seven senior 
members of the Staff of the Instructional Film Research Program 
was appointed to assist the Director in the administration of 
the Program,, 

It was found necessary to reduce the amount of part- 
time and extra-time services of regular faculty members until 
more funds were made available for the Program® Limitations 
of funds, also, precluded the appointment of additional 
Graduate Research Fellows (Navy)® It was decided to build up 
as far as possible a core of experienced staff members and to 
this end two previous Research Fellows, Dr® Philip Ash and 
Dr® Nathan Jaspen were employed as Staff members® Furthermore, 
arrangements were made to retain Mr® Leslie P® Greenhill for 
a further year® 

The problem of adequately staffing the Instructional 
Film Research Program remains acute® Individuals who have the 
required abilities, training and interest, and vh o will accept 
salaries within the scale established by the College are diffi- 
cult to find® It seems to be necessary that junior members of 
Staff or advanced graduate students should be trained on the 
Program and retained for advanced professional research® 

Indeed, the training function of the Program may be one of its 
most important contributions to the field of research ^nd 
instruction involving the media of mass communication. 
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LIAISON ACTIVITIES 



The most important development relative to liaison 
activities was the organization of a Joint Military Services 
Advisory Committeeo The formation of this committee was 
made both desirable and necessary for the following reasons? 
lo The support of the Program by the Department of the Army 
cooperat ively wi th sponsorship by the Department of the Navy, 
through the Special Devices Center, made it necessary to have 
official channels through which the broadened interests of the 
Military Services could be represented to the Instructional 
Film Research Program,, 2„ It was necessary that the immediate 
practical problems of the Military Services be presented to 
the Instructional Film Research Program Research Staff for 
their implications and use in film investigations,, 3o It was 
also desirable that the. results of experimentation on instruc- 
tional and informational films be presented informally and 
dxscussed with representatives of the Military Services who 
could in turn apply these results to film production and 
utilization 4„ It was necessary from time to time to arrange 
for practical cooperation between the Instructional Film 
Research Program and various branches of the Military Services 
on production and testing jobs 0 5 0 It was desirable to have 

the assistance of representatives of sponsoring services both 
in general research program planning and individual research 
project planning 0 It is expected that the Joint Military 
Services Advisory Committee, which in the future will meet 
quarterly, will serve these and other valuable functionso 

Those persons who are responsible for administering 
the Instructional Film Research Program have accepted the 
responsibility for making the results of experimentation 
known to those who may wish to use them,, It is believed that 
scientific investigators have an obligation to communicate 
the results of their work to those who may apply them, and 
in turn benefit those who support the research,. To this end 
the Instructional Film Research Program reports are being 
written in several forms for different audiences,. Every as- 
sistance possible is given Special Devices Center in dis- 
tributing the reports widely and effectively,. Furthermore, 
within the limits of time available, members of the Film 
Research Staff meet with professional groups to present and 
interpret the experimental results,, Lectures and demonstra- 
tions have been given, for example, to the Washington Film 
Council, to the New York Film Council, to the Calvin Company 
Workshop , and to the University Film Producers Association,, 

As a result of these efforts the work of the Instructional 
Film Research Program is becoming widely and favorably known 
throughout the United States and other countries,. The re- 
ception of reports, lectures and demonstrations has been 
enthus iast ic „ Currently, a principal concern of the Instruc- 
tional Film Research Program Staff is that it shall measure 
up to the high levels of expectancy held by the many friends 
of the Program,, 
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OPERATIONAL PROBLEMS 



The main operational problems for the period of 
report were: 1- The completion of final technical reports- 

Unanticipated complications in statistical analyses have 
delayed several reports, particularly those for which 
Dr, VanderMeer was the project leader- The report on research 
literature on which Dr. Hoban worked effectively during the 
summer and vvhich Dr. vanOrmer was responsible for completing, 
has been overly long delayed- 2- Several projects not yet 
up to the final report stages, have not progressed according 
to reasonable expectations- Project Number 3, for which 
Mr- John is primarily responsible, and Project Number 33 under 
Mr- Abramson fall into this class- In general, the main pro- 
blem here is that of completing, through the stage of final 
report writing, the research projects which have been under- 
taken- . 



A minor operat ional problem which gives the Research 
Staff some concern is that of answering the two following 
questions? 1- What proportion of time and effort should be 
spent actively assisting the military services to improve 
specific training and instructional sound film productions? 

2- H©w can this best be done? Pilot procedures have been 
decided upon and are being put to test with selected films 
which are being produced by the Army Signal Corps- 

Since last spring no new research projects have been 
undertaken because of the obvious wisdom of completing those 
already initiated- With the completion of a fair percentage 
of major projects, the time is rapidly approaching when work 
involving the restructuring of the actual research program, 
and the developing of additional research projects, will be 
in order- 



A PRELIMINARY REPORT ON PROJECT NOo 12 



- RELATIONSHIP OF LENGTH AND FACT FREQUENCY TO 
EFFECTIVENESS OF INSTRUCTIONAL MOTION PICTURES 
W. S. Vincent*, P. Ash and Lo P» Greenhill 
STATEMENT OF THE PROBLEM 

The purpose of this research is to determine the ef- 
fect on learning of varying (l) the total amount of information 
presented in a film of a given length, and ( Z ) the length of 
time allotted to conveying a fixed amount of informat ion* The 
experimental question posed is: Does increasing thr fact 

density of a film result in a proportionate increase in the 
learning accomplished? 



EXPERIMENTAL DESIGN AND PROCEDURES 



The F i 1ms 

Using as source material a series of films on aero- 
logyl, visual material was selected for inclusion in four 
versions of an introductory film on the weather,, 

”The Weather” covered, in more or less detail de- 
pending upon the version, the basic facts with respect to the 
formation and characteristics of frontal weather, and the 
effect of weather conditions on flying,. 



A careful content analysis of a tentatively selected 
body of material was made to permit controlling within narrow 
limits the content of four versions of the film,, 

The unit of content employed was the individual 

^ Dr o W o ST VTncent was the initial project leader,, 
Extensive work on this research was done by the 
Film Research Staff 

1 The source films were in color and in animat ion 0 
They had been produced by the Walt Disney 
studio for use by the Department of the Navy* 

The films included: 



Aerology - Fog (MN-119B), 

Aerology - Air Masses and Fronts (MN-119D), 
Aerology - The Cold Front (MN-119E) 9 
Aerology - The Warm Front (MN-119F), 
Aerology - The Occ luded Front (MN-119b)o 
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fact , and a fact was defined a-s any item about which a question 
cou 1 d be askedo This was designated as the "questioning to 
exhaustion** technique of testing.. To identify all the facts 
in each script, a committee of eight or nine IFRP Staff Members 
read preliminary drafts, and wrote questions for every item 
mentioned., The Scripts were modified so that the number of 
facts in each version could be carefully specified.. The scripts 
for the two films of each length included f acts in the ratio of 
1:2* However, the total number of words in each pair of equal 
length was kept constant by the use of repetitions, prefatory 
statements* and other filler material which did not add new 
facts* Illustrations and examples were considered as repe- 
titions* This material was included in both the visuals and 
the commentary* One version, designated as Long Heavy , 
included all the facts used* This version ran 30 minute-s* A 
second version, the Long Light , included half the facts used 
in the Long Heavy but also ran 30 minutes* A third version, 
the Short Heavy , included all the facts that were in the Long 
Light version, but ran 15 minutes* Finally, a fourth version, 
the Short Light , also running 15 minutes, included only half 
the facts found in either the Short Heavy or the Long Light 
version* 



To ensure further that the commentar ies of the four 
versions were of equal verbal d if f icu 1 ty , and that the leve 1 
of verbal d if f icul ty was appropriate for twelfth grade high 
school students or military trainees of equivalent education, 
an analysis of the reading level of the four scripts was made 0 
The Dale-Chall formula-^ was used for this purpose, and minor 
changes were made in the commentaries to obtain equality of 
reading difficulty* The formula is based on two counts? 
average sentence length, and percentage of unfamiliar words* 

Table I summarizes the characteristics of the scripts 
for the four versions* The four versions were in color ani- 
mation and in sound* 



The Tests 

An ob ject ive-type test employing four-choice questions 
was constructed* The questions used were those formulated to 
identify the facts in the films* Since a test of 224 items 
was considered too long, a sample of 136 of the questions was 
selected* The distribution of question coverage for the 
versions is also given in Table I* The same test was used for 
all groups* 



Dale, E*, Chall, J* S* Formula for predicting readability* 
Ed* Res* Bui*, 1948, 27 , 11-20, 37-54 
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TABLE I 



CHARACTERISTICS OF THE EXPERIMENTAL 
VERSIONS OF "THE WEATHER 1 * 



Vers ion 

Long Heavy Long Light Short Heavy Short Light 



Running Time 

Total Number 
Facts 



28 0 8 min 0 
of 224 



29o 1 m in 0 

112 * 

3 o 85 
3596 
123o 7 



14o3 min 0 
112 * 

7 0 85 

1745 

122o3 



Facts per minute 7*77 

Total Number of 

Syllables 3599 

Syllables per 

minute 124<>9 



14o3 m in, 
56 

3o91 

1760 

122o 8 



Verbal Diffi- 
culty of 
Scr ipt 

Dale-Chal 1 Score 6«8071 

Grade Level 7-8 

Number of Items 

in Test 136 



6o89l 1 
7-8 



89 % 






6.9652 

7-8 



89** 



6.7320 
% 7-8 



45 



% Same facts 

** Same items 



Exper imenta 1 Procedures 

The general procedure followed involved showing each 
of the four versions to one of four comparable qroups, and 
testing these four groups and a comparable fifth Control Group 
which was not shown a film® The mean scores were compared for 
(1) the entire test, (2) for the items common to all but the 
Short Light version, (3) for items common to all versions, and 
(4) for items only in the Long Heavy versiono 

Three replications were conductedo The replications 
are summarized in Table 2 0 




The first replication employed twelfth grade students 
in the Lewistown,Williamsp ort, and Sunbury (Pennsy Ivan ia) h igh 
schools© In each school five groups were used* The high 
school students were tested for immediate recall and for four- 
weeks delayed recallo 

The second replication employed ten flights of recruits 
(basic trainees) in the Air Force (Lackland Air Force 
Base, San Antonio, Texas)© Each film version wao shown to two 
flights, who were tested immediately and again seven weeks later© 

The third replication employed students in five s ec- 
tions of a course in elementary meteorology at The Pennsylvania 
State College© These subjects were tested once only, one 
week after the film showings© 



TABLE 2 

SUMMARY OF THE EXPERIMENTAL REPLICATIONS 



Repl icat ion 

High School Air Force College 



434 

Male and female, 
12th grade stu- 
dents, five groups 
in each of three 
high schools© 



513 

All male, ten 
intact compan- 
ies of Air Force 
basic trainees 
(two companies 
to each treat- 
ment ) 



Apr i 1 -May 



Number of 
Subjects 

Character 



Date of 
Study ( 1949 ) 



Treatment ; 
Films 



Retention 

Test 



Delayed 
Recall Test 



Yes (except 
for control 
group 

Immed ia te ly 
after f i lm 



Four w eeks 
after film* 



June -August 



Yes (except 
for- control 
group ) 



Immed late ly 
after film 



Seven weeks 
after film 



324 

Male and fe- 
male, in five 
intact sec- 
tions of an 
introductory 
course in 
Meteorology 



September- 

October 



Yes (except 
for control 
group) 



One week 
after film 



None 



* Delayed recall test not readministered to Control Group© 



m « f 
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The Populations 

The distributions on available criteria for the 
three populations used in the study are given in Table 3. 

For the high school students, only sex distribu- 
tion data was obtained* In each high school, students were 
taken from their classes and distributed among the five 
treatment groups so a s to ensure more or less comparability 
with respect to sex, course in which they were enrolled, 
and similar factors* The groups, as finely constituted 
did not differ s ignif icantly w i th respect to sex distribu- 
tion (Chi-square not significant at the 30 per cent level)© 

For the Air Force basic trainees, only educational 
level was obtained* The methods of company formation employed 
in the Air Forces are such that one may be reasonably con- 
fident that each intact company (flight) is a random sample 
of the whole Ajr Force basic recruit population*. Therefore, 
intact flights were used, without further randomization* 

The treatment groups (two flights each) did not depart sig- 
nificantly from homogeneity with respect to educational level 
(Chi-square not significant at the 10 per cent level)* 



For the College students 
culum data were available* Intac 
the four f i lm groups* The Contr 
class plus those student c in the 
absent when the films were shown* 
treatment groups, as here defined 
from homogeneity with respect to 
culum distribution (Chi-square si 
level or better in both cases)* 



, sex, semester, and curri- 
t classes had to be used for 
ol Group comprised a fifth 
other four classes who were 
It may he noted that the 
, departed significantly 
sex distribution and curri- 
anificant at the 5 per cent 



} 
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TABLE 3 



DISTRIBUTION OF SUBJECTS BY SEX, SEMESTER, CURRICULUM 
AND/OR EDUCATION FOR THE COLLEGE, HIGH SCHOOL, AND AIR FORCES 

POPULAT IONS 



COLLEGE POPULAT ION 



Group 


Sex* 


Semester^ Curriculum^ 






M 


F 


1-4 5-6 7-8 Sci 


«Ag • 


LA 


Total 


Long Heavy 


27 


6 


5 11 17 13 


8 


12 


33 


Long Light 


65 


13 


6 18 54 32 


19 


27 


78 


Short Heavy 


38 


8 


9 12 25 11 


12 


23 


46 


Short Light 


80 


2 


14 18 50 16 


20 


46 


82 


Control 


73 


22 


n 21 47 25 


22 


48 


85 


TOTAL i 


283 


41 


51 80 193 87 


81 


156 


324 






HIGH SCHOOL POPULATION 










Sex 4 










Group 


M 


F 










Long Heavy 


40 


40 








80 


Long Light 


43 


48 








91 


Short Heavy 


34 


49 








83 


Short I ight 


32 


49 








81 


Control 


50 


49 








99 


TOTAL 


199 


235 








434 






AIR 


FORCE POPULATION 














Educat ion^ 












Grade 


High 








Group 




School 


School College 






Long Heavy 




15 


92 


0 




107 


Long Light 




12 


94 


1 




107 


Short Heavy 




9 


93 


5 




107 


Short Light 




19 


75 


2 




96 


Control 




1 3 


71 


2 




86 


TOTAL 




68 


425 10 




503 


lo 


Chi 


-square 


= 10.89 s „05> P >„02 






4 o 


£h i 


-square 


= 8c 16, P > o oO _ 








O o 


'.hi 


-square 


* 16.78, o 05 r > o 02 








4. 


Chi 


-square 


= 3.60, P > .30 








5o 


Chi 


-square 


= 4.80, P > .10 
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RESULTS 



The means for the film test scores for the groups 
seeing the four versions and for the Control Group are re- 
ported in Tables 4 (High school students), 5(Air Force basic 
trainees), and 6 (College meteorology students )o For each of 
the five groups, means and related statistics are given for 
the following scores* 

Vi Score - based on 47 items covered by the Long 
Heavy version only* Mean scores for the groups seeing the other 
versions, where these mean scores were higher t h sn the Con- 
trol Group means, may be attributed to inferenceSo 

V3 Score - based on the 44 items common to the 
Long Heavy , Long Light , and Short Heavy versionso These 
items were not covered in the Short Light version 0 

V4 Score - based on the 45 items common to all 
four versionso This score represents a measure of direct 
learning on all the tested material in the Short L ight version c 

Tz Score - this is the sum of the V3 and scores 0 
It is based on the 89 items covered in the Long Light and 
Short Heavy versionso 

Total Score - based on all the 136 itemSo This 
score covers all the information included in the Long Heavy 
vers i on« 

The tables of differences among the versions will 
not be included in this report, but they will be summarized 
br ief ly * 



The following findings may be stated? 

lo S ign if leant f orge 1 1 ing took place o For 
both the high school sample (4-week interva 1 ) and the Air Force 
sample ( 7-week interval) the delayed recall test mean scores 
were about one standard deviation lower than the immediate re- 
call means, and this difference was, in almost all cases, 
significant at the 0*1 percent level of confidence 0 The 
anomalous finding (T a ble 5) that significant ’’forgetting” 
took place in the Control Group in the Air Forces (this group 
did not see a film and, theoretically, learned nothing to 
forget) may be explained on the basis of very poor motivation 
on the recall testo This second administration of the long 
test presented the Control Group with an extremely frustrat- 
ing task for the second time • On the second occasion, the 
group largely ’’gave up” and answered randomly 0 

Zo S ign if icant learning took place 0 For both 
the immed iate reca 1 1 test and the d e layed reca 1 1 test, for all 
three populations, almost every film group mean score is sub- 
stantially (more than one standard deviation) and significant- 
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ly (at the 0* 1 percent level of confidence) greater than the 
comparable Control Group score, The only exceptions were as 
follows; the V j and de layed recal 1 means for the Short 
Light group in the high school sample were not significantly 
clif fer ent from the high school Vj and means for the Control 
Group; and the Vj and means for the Short Light group 
in the College population were not significantly different 
from the College Control Group means for these scores. Since 
the Vj and scores pertain to information not shown to the 
Shor t • L jght group, this finding is not surpr is ing * 

3 * Some inferential l earning took place o This 
is the converse of the finding reported above „ Although not 
actually shown the items entering into the \f\ Score, the members 
of the Long Light and Short Heavy groups in all populations 
earned higher scores than the comparable Control Groups did, 
for both immediate and delayed recall tests 0 Furthermore, with 
the exceptions noted above, the Short Li ght group inferred 
significantly more Vj and V3 items than did the comparable 
Control Groupso 



4 0 With regard to the inter-vers ion comparisons, 
the following comments seem justifiable; 

a c The "best" version, in an all-around 
sense, on the basis of the total score, differed from sample 
to sample 0 For the High School sample, the Short Heavy ver- 
sion seemed the most effective 0 For the Air Force and the 
College samples, the Long Light version seemed to b e most 
effect ive. 



bo In the Air Force and High School 
samples, the Long Heavy group scored significantly higher than 
any other on the Vj score for the immediate recall test 0 At 
the end of the delayed recall interval, however, this differ- 
ence approached zero, and was not significant in a statistical 
sense. In the College sample the Long Heavy group had a 
higher Vj score than any other group at the end of one week,, 
but only the difference from the Short Light group was sta- 
tistically significanto 

The Vi score covered items included explicitly 
only in the Long Heavy version 0 

Co In general, the Short Light Groun 
scored higher on the V4 score (items common to all versions, 
and the only items in the Short Light version) than any other 
group* These d if f erences w ere not large, however, and only a 
few were significant at the 5 percent level or better 0 

do At the end of the delayed recall 
period, all differences among the versions were much smaller 
than they had been on the immediate re tent ion test , and most 
of them were not significant* 



TABLE h 



MEANS, STANDARD DEVIATIONS, AND STANDARD ERRORS OF MEANS FOR 
IMMEDIATE RECALL AND DELAYED RECALL SCORES, FOR HIGH SCHOOL POPULATION 



Group 


NOo of Immediate 
cases Mean S 0 D. 


Recall 

SE n 


Delayed Recall 
Mean S 0 ^ 0 SEjjj 


Mean 

Diffo 


r 


Total Score 
L H 


80 


62.2 


16.2 


lo82 


5o.i 


i5.lt 


1.73 


12 0 1**-* 


.77 


L L 


91 


63.0 


17.3 


1 0 82 


52.9 


15.8 


1.67 


10® 1*** 


.81 


S H 


83 


61t.l 


15.8 


lo7U 


5U.7 


i5.lt 


1.70 


9 0 li*** 


.90 


S L 


81 


58.1 


15.0 


I 068 


U7.2 


lit. 2 


1.59 


10.9*** 


.80 


C 


99 


U2.1 


7.9 


08 O 













1*2 Score 



L H 


80 


ltl.9 


11.5 1.29 


33.8 


11.0 


lo2U 


8.1*** 061 


L L 


91 


U5.6 


13.lt l.ltl 


36.9 


11.9 


lo26 


80 7**-* o?6 


S H 


83 


I16.6 


12.6 1.39 


38.1 


11.5 


lo27 


8.5>*** 088 


S L 


81 


ltl.2 


11.3 1.27 


32.lt 


10.5 


1.17 


808*** 0 79 


C 


99 


28.1 


5.7 .57 










Vi Score 
















L H 


80 


20.lt 


5.1t .61 


16.3 


5.6 


.63 


lj,oO*** 067 


L L 


91 


17.5 


5.0 .52 


16.0 


It. 8 


o*> 


l.U*** oil 


S H 


83 


17.lt 


It. 2 .1*6 


l6„6 


U.5 


oU9 


0 8# 0 3>6 


S L 


81 


16.9 


lt.6 .51 


Hu 8 


>'.6 




2d*** o£3 


C 


99 


llt.O 


3. It .35 











V 3 Score 



L H 


80 


20.5 


6.U 


o72 


160 7 


%o7 


06k 


3.8*** .71 


L L 


91 


22.3 


6®J> 


069 


17o9 


5o3 


<»f>6 


Uo5&** o?l 


S H 


83 


23.5 


6 0 8 


o75 


I80U 


6.3 


.70 


5oX*** 08I 


S L 


81 


16.7 


$.3 


o59 


1U0U 


5.0 


0^6 


2.3*#* ©67 


C 


99 


13.9 


3oU 


o3U 










Score 


















L H 


80 


21.lt 


So9 


067 


17ol 


6.1 


069 


l4. 0 3*** <»6£ 


L L 


91 


23.3 


7oS 


o 79 


19o0 


7o3 


o77 


1* 0 3*** .66 


S H 


83 


23.1 


6.5 


o72 


19o7 


6.1 


067 


3ol 1*** <>79 


S L 


81 


2!t.5 


7o3 


0 82 


I80O 


6.6 


o7U 


6 0 f>*** o70 


C 


99 


lit. 2 


3o7 


o37 











* Significant at the £ percent level of confidence 
** Significant at the 1 percent level of confidence 
#** Significant at the 0.1 percent level of .confidence 
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TABLE 5 

MEANS , STANDARD DEVIATIONS, AND STANDARD ERRORS OF MEANS FOR 
IMMEDIATE RECALL AND DELAYED RECALL SCORES, FOR AIR FORCES POPULATION 





-1 r. 




Group 


No, of 
cases 


Immediate Recall 
Mean S.D„ SEjj 


Delayed Recall 
Mean S.D. SE m 


Mean 

Diff. 


r 


Total Score 


L H 


107 


54.7 


13.1 


1.27 


42.7 


10.7 


loOU 


12.0*** 


.63 


L L 


107 


56.1 


iio9 


1.16 


44.8 


10,2 


.99 


11,3*** 


,6x 


S H 


107 


52.6 


13.6 


1.32 


44.2 


10,8 


1.05 


8.U*** 


.oU 


S L 


96 


50.6 


13.0 


1,33 


42.4 


9.0 


.93 


8.2*** 


.55 


C 


86 


40.5 


8.$ 


.92 


35.8 


6.1* 


.69 


U.7*** 


.38 


T 2 Swre 


L H 


107 


37.5 


9.0 


.87 


28.7 


7.6 


.73 


8.8*** 


.58 


L L 


107 


40.4 


9.2 


.90 


30.8 


7.6 


.74 


9.6*** 


0 6U 


S H 


107 


37*9 


10,7 


l.oU 


30.3 


7.8 


.76 


7.6*** 


.63 


S L 


96 


35.5 


9.6 


.99 


28.6 


6.9 


.71 


6.9*** 


.1(6 


C 


86 


27o2 


6.5 


.70 


24.2 


5.3 


.57 


3.0*** 


.30 


V^ Score 


L H 


107 


17.2 


5.0 


oU8 


14.0 


h.2 


.Ul 


3.2*** 


.49 


L L 


107 


15.7 


h*2 


.Ul 


14.0 


U.o 


.39 


lo 7** 


.36 


S H 


107 


14.7 


U.i 


oU0 


13.9 


U.i 


.39 


.8* 


.45 


S L 


96 


15.0 


u.5 


•1(6 


13.8 


3.5 


.36 


1.2** 


.45 


C 


86 


13.3 


3.U 


.36 


11.6 


2,7 


.30 


1,7*** 


.34 


V^ Score 


L H 


107 


18.9 


1(.7 


.1(6 


13.7 


3.9 


.38 


2.2*** 


oU5 


L L 


107 


20, h 


1(.7 


.1(6 


li(.7 


ho2 


.UO 


5.7*** 


.58 


S H 


107 


19*k 


5.7 


.56 


1U.6 


U.2 


.1(1 


U.8*** 


.65 


S L 


96 


15.0 


U.7 


.1(8 


13.6 


3.3 


o3l( 


1, !(■*** 


«3U 


C 


86 


13 a 


3.7 




11.9 


3.U 


.37 


1.2* 


.16 


Vi Score 


L H 


107 


18.6 


5.3 


.52 


15.0 


4.5 


.44 


3o6*** 


.52 


L L 


107 


20.0 


5.5 


o5U 


16.0 


4.7 


.45 


U,o*** 


chh 


S H 


107 


18.5 


5.9 


.57 


15.7 


4.7 


.46 


2.8*** 


okh 


S L 


96 


20.6 


6.2 


.63 


15.0 


4.7 


.49 


£.6*** 


oho 


C 


86 


14.0 


3.8 


.1(1 


12.3 


3.3 


.36 


1.7*** 


.19 



* 

** 

■*** 




'2 
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TENTATIVE CONCLUSIONS 



The findings for the study may be summarized in 
the following ways 

The more that is included in a film, the more will 
be learned, in absolute amount of that information (e.g., 
the score finding for Long Heavy group). However inferences 
about non-included but related information may make up for 
failure to present i + explicitly in the film. The superiority 
of the Long Light or Short heavy versions may be attributed to 
such inferences. 

The data suggest that as more and more information 
is presented interferences are set up that result in less 
efficient learning of any particular part (e,go , the findings 
on the V4 score - the Short Light Group generally did better 
than any other group on these items,) 

Finally, it seems clear that packing more and 
more information into a film yields only very slight increments 
in total measured learning. In no case did the Long Heavy 
Group seem to learn anywhere near twice as much as the Shor t 
Heavy or Long Light Groups, nor did these latter learn twice 
as much as the Sh or t Light Group, 

Analysis of the test performance suggested that 
the f i lms were rather difficult for the populations used, and 
observation of the a ttitude and performance of the groups 
suggested that they were not very well motivated or very in- 
terested. It should be noted that this interpretation is not 
inconsistent with the fact that the read ing leve 1 of the 
scripts (as measured by the Dgle-Chall formula") is at the 
seventh or eighth grade. These films seemed tobe conceptually 
difficult. Furthermore, although each fact was couched in 
simple words, so many facts were presented per unit Of time 
(about 4 per minute in the lightly packed versions) that grasp- 
ing a large proportion of them was unlikely. 

Another replication is planned employing pre-flight 
trainees who will have some background against which to assimi- 
late a larger share of the information presented in these films. 
The subjects in the three replications conducted to date seem- 
ed to lack interest in and preparation for the material includ- 
ed in these films. This lack of interest and preparation may 
well have been the central factor responsible for the test 
find ings . 



A PRELIMINARY REPORT ON PROJECT NO. 17 



PART I : CONTRIBUTIONS OF FILM INTRODUCT IONS 

TO LEARNING FROM INSTRUCT IONAL FILMS 
Co W* Lathrop, Jr c 
STATEMENT OF THE PROBLEM 



Introduct ion 



There is a certain amount of evidence to suggest that 
an oral introduction to a film for the purpose of orienting 
and motivating the audience, results in more learning 0 This 
raises the questions; (l) Is the introduction as provided 
with in the usual instructional film equally valuable! (2) if 
not, can it be improved; and (3) what functions can it be 
expected to perform? These questions are expec ial ly import- 
ant relative to instructional tasks which are to be accomplish 
ed by sound motion pictures exclusively,, 

This study is primarily concerned with investigating 
the contributions to learning of some typical introductory 
sequences in extant instructional filmso 

Def ini t ion of Terms 

A Film Introduction is defined as that portion of a 
film, excluding the main and credit titles, which begins the 
presentation, and runs up to the beginning of the body of the 
film. 



) 



The possible functions of an introduction to a film 
may be classified under the following 11 headings: 

1. Stresses the importance of the material in 

the film. 



2 . 

the film is not 
close attention 
be endangered. 11 ) 



Stresses the consequences if the material in 
learned. (For example, "If you don't pay 
to this film the lives of your buddies might 



f i lm. 



3o Introduces the characters to appear in the 



film. 



4. Poses the problem to be dealt with in the 



5. Sets the stage , that is, orients the audience 
to the scene of the action. 

6° Po ints out important features which will be 
developed in the film and to which the audience should pay 
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me 






J 



special attention. 



7, Gets attention of the audience by some drama- 
tic device, 

8, Shows the trainee the relevance of the materi 
al in the film to what he has learned previously, 

9, Exp la ins to the instructor the situation for 
which the film is intended, 

10, Provides additional inspiration which might 
motivate the student or trainee to undertake further activi- 
ties after seeing the film, 

11, Shows the purpose of the f i lm , (Probably 
one of the most important functions of an introduction is to 
tell the student exactly what the film is about,) 

The filmic techniques which may be used to attain 
these objectives may also be classifieds 

1, Live action (simple movement as from real 

life. 

2. w Dramat ic w 1 ive act ion (action used with 
dramatic effect) 

3° Use of models (scale representations) 

4, Animat ion 

5, ^lashes forward (short shots of scenes to 
follow are included in the introduction) 

6, Titles to explain the film, etc, 

7, Remarks by an authority on the subject 

8, Narrat ion by an off-stage commentator 

9, Demonstrat ion of a task being performed 

10, Slow motion or speeded mot ion 

11, Diagrams , still shots, tables, graphs 

t 

i&. Aud ience part ic ipat ion (as in asking a 
question and allowing time for an answer) 



PROCEDURE 

Review of Film Introductions 



One hundred and thirty instructional films with 



introductions were viewed, and were analyzed and classified 
as to the following characteristics: 

1* Length of the introductory sequences 

Z • Length of the entire film 

3. Classification of film subject matter 

4. Identification of the functions or objectives 
of the introduction 

5. Identification of the filmic techniques 
used in the introduction 

A check sheet was prepared to record each film 

analys is. 



For the sake of convenience and uniformity the sur» 
vey was restricted to films in the 8-13 minute time range. 



Table I gives the classification of film introductions 
in terms of their functions, Table II shows the range of film 
techniques used, and Table III the lengths of the introduc- 
tions in relation to total film length. 



TABLE I 



NUMBER OF FILM INTRODUCTIONS USING EACH OBJECTIVE 

k 



1 ) 







Objective Coronet 


EBF 


Producers* 
CNFB Castle 


YAF 


Others 


Number of 
F i 1ms Ana lyzed 


42 


25 


10 


10 


8 


35 


Stresses Impor- 
tance 


36 


20 


7 


8 


5 


26 


Stresses Conse- 
quence 


3 


- 


- 


1 


- 


3 


Introduces Char- 
acters 


32 


9 


7 


8 


't 

O 


20 


States Problem 


24 


22 


5 


10 


5 


24 


Sets Stage 


13 


5 


5 


- 


3 


16 


Points out Im- 
portant 
Features 


1 


2 


1 




1 


2 


Gets Attention 


6 


- 


mm 


1 


- 


2 


Shows Relevance 
to the 
Trainee 


1 


_ 




2 




1 


Explains to In- 
structor 
Situation 
for which 
Film was 
Intended 








1 




ora 


Additional Inspir 
at ion 


- 


- 


- 


- 


- 


1 


Shows Purpose of 
the Film 


- 


- 


- 


- 


- 


C5? 





* Producers: 

EBF - Encyclopaedia Britannica Films 
CNFB - Canadian National Film Board 
YAF - Young America Films 
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TABLE 2 



NUMBER OF FILM INTRODUCTIONS USING EACH TECHNIQUE 



















Film 

Technique 


Coronet 


EBF 


Producers# 
CNFB Castle 


YAF 


Others 


Number of 
Films Analyzed 


42 


25 


10 


10 


8 


35 


Dramatic Live 
Action 




1 


- 


- 




mm 


Live Action 


41 


21 


6 


10 


5 


31 


Models 


1 


2 


5 


- 


2 


1 


Animat ion 


- 


3 


4 


- 


1 


6 


Flashes For- 
ward 


4 


1 


- 


- 


- 


mm 


Titles 


4 


- 


- 


- 


1 


3 


Authority- 


- 


2 


- 


- 


- 


3 


Narrator 


42 


23 


10 


10 


8 


32 


Demonstrat ion 


8 


5 


- 


7 


2 


8 


Slow Motion 


2 


- 


- 


- 


mm 


- 


Diagrams 


7 


7 


- 


mm 


1 


3 


Audience Parti 
c ipat ion 


- 


- 


- 


- 


- 


- 

















# Producers 

EBF - Encyclopaedia Britannica Films 
CNFB - Canadian National Film Board 
YAF - Young %ierica Films 
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The F i 1ms Used in the Experiment 

The experiment proper was concerned with measuring the 
effect on learning of the introductory sequences of several 
typical instructional films. 

The three films finally chosen as having what seemed to 
be the best available introductions were? (1) Sulphur and 
its Compounds , ( 2 ) M amma 1 s of t he Rocky Mounta ins , and (3 ) 
Rivers of the Pac if ic Slope , 

Their characteristics are given in Table 4 

TABLE 4 

CHARACTERISTICS OF FILMS USED IN THE EXPERIMENT 





Total 
, Fl im. 
Title Length 


Length of 
Introduc- 
tion 


Functions 
of Intro- 
duction 


l“ilm Techni- 
que used in 
Introduction 


Subject 

Type 



Sulfur 
and its 
compounds 


387 ft. 
10 min, 
43 sec. 


65 . sec. 
10.1* 
of total 


( 1 ) Stres- 
sing import- 
ance 

(2) Intro- 
ducing char- 
acters 

(3) Setting 
the stage 


( 1 ) Live 
action 

(2) Models 

(3) Title 

(4 ) Narra- 
tion 


general 
sc ience — 
chemistry 


Mamma 1 s 


369 ft. 




(1) Setting 


(1) Live 


general 


of the 


10 min. 


45 sec. 


the stage 


act ion 


science- 


Rocky 


15 sec. 


7.3% of 




(2 ) Anima- 


biology 


Mountains 




total 




t ion 












(3) Narra- 












tion 




Rivers 


414 ft. 




( 1 ) Stres- 


(1) Live 




of the 


11 min. 


25 sec. 


sing import- 


act ion 




Pac if ic 


30 sec. 


3,6% of 


ance 


(2) Narra- 


genera 1 


Slope 




total 


(2) Setting 


tion 


sc ience - 



the stage geography 

(3) Posing 
the problem 



Two experimental versions were prepared for each of 
the three films? Version I was the complete films Version 
II was the same film minus the introductory sequence only . 

The preparation of the ,f no introduction** versions was a 
comparatively easy matter as, in each film, there was a fade- 



31 



out of the visua Is and a break in the sound track between the 
credit titles and the introduct ion, and between the intro- 
duction and the main body of the film* The main title and 
credit titles were included in both versions of each film* 

The Tests 



Tests were constructed on the material in each of 
the three films, bearing on the facts in the body of the 
film only ; no questions were asked on the facts contained 
only in the introduc t ion* Multiple-choice test questions 
each with four choices were asked on three different classes 
of facts in the filmss 

(1) the facts contained in the visuals only 

(2) the facts contained in the sound track 
only 

(3) the facts found in both the visuals and 
sound track 



Pilot-runs were made to check the validity and re- 
liability of the tests, and poor questions were eliminatedo 
Each test finally included from 50 to 60 items * 



Test Popu lat ion 

Approximately 500 ninth grade high school students 
from the Lewistown and Lock Haven, Pa 0 , High Schools took 
part in the experiment Good cooperation from the schools 
made it possible to achieve a practical degree of randomi- 
zation of the entire ninth grade population in each school 
into three groupSo This was done by taking alphabetical 
lists of boys and girls respectively, and assigning students 
in rotation to experimental groups 1, 2, and 3o This pro- 
cedure also gave a uniform number of boys and girls in each 
groupo 



One group acted as a control group and took the 
test without seeing a film* The second group saw the complete 
film (Version I), while the third group saw the "no-intro- 
duction” version (Version II)* The groups were rotated so 
that each group became a different experimental group for 
each of the three films* Thus, each g roup acted as a control 
group for one film, a s a groupseeing the version without the 
introduction for another, and finally, as a group seeing tbe 
entire film for the third* The groupsvere also rotated with 
respect to projection rooms and test administrators* 

The test followed immediately upon the film-showing* 
Twenty-five minutes were allowed for its completion* Thus 
a single forty-five minute period provided ample time for 
showing a film, and giving the test* 



SUMMARY OF RESULTS 



The question to be answered in this experiment iss 
What contributions do the introductory sequences in these 
films make to learning? The complete results will be given 
in the final technical report! only summaries of the test 
scores will be given here* 

TABLE 5 

SUMMARY OF TEST SCORES 
»/ 

"Sulfur and Its Compounds” 





Control 
Group 
(No Film) 


Film minus 
In t r outi'ct' fdn 
Group 


Complete 

film 

Group 


Number of Subjects 


168 


166 


168 


Mean Score 


16o97 


2lo61 


22© 75 


Standard Deviation 


3 ©43 


5©45 


5o 36 


Standard Error of 
the Mean 


©27 


©42 


©42 



TABLE 6 

SUMMARY OF TEST SCORES 
"Mammals of the Rocky Mountains" 





Control 
Group 
(No Film) 


Film minus 

Introduction 

Group 


Complete 

Film 

Group 


Number of Subjects 


168 


171 


174 


Mean Score 


ZZc55 


31 ©23 


28 © 68 


Standard Deviation 


4 ©93 


7©27 


6 © 63 


Standard Error of 
the Mean 


o38 


©56 


©50 



TABLE 7 



SUMMARY OF TEST SCORES 



"Rivers of the Pacific Slope" 





Control Group 
(No Film) 


Fi lm minus 
Introduct i on 
Group 


Complete 

Film 

Group 


Number of Subjects 


165 


167 


164 


Mean Score 


16o23 


22„ 96 


24 0 77 


Standard Deviation 


4 0 10 


5 0 95 


6 0 70 


Standard Error of 
the Mean 


„32 


0 46 


o 53 



Those results indicate that the groups which saw the 
experimental films generally did somewhat better than the con- 
trol groups which did not see the films 0 However the differ- 
ences between the groups which saw the ent ire f i lm, and those 
which saw the film minus the introduct ion vr*re small 0 For 
two films the introductions apparently made smal 1 positive 
contributions ("Sulfur and Its Compounds" / 1 0 14 "Rivers of 
the Pacific Slope" / l 0 81**-)s> while for the third film, 

"Mammals of the Rocky Mounta ins f J the introduction apparently 
had an adverse effect on learning, the difference between 
the experimental groups being ~2„5 This latter unex~ 
pected result was carefully checked and proved to be authentico 



CONCLUS IONS 

The results indicate that an ong existing films, 
typical introductory sequences can make small positive con- 
tributions to learning, while in other instances introduce 
tions may have an adverse effect on learning, possibly through 
misdirecting the student’s attention,, 

This shows that there is an urgent need for an experi 
mental approach to the problems of producing film introductions 
based on sound learning principles, which will make positive 
contributions to learningo These should help to offset short- 
comings in methods of presentation when using films to supple- 
ment instruction, or as an exclusive means of instruction 
The next step inthis direction could be an evaluation of the 
relative importance of the different functions which a film 
introduction might perform,. 



* Significant at the 6% level of confidence 
Significant at the 1% level of confidence 

•SBHt- Significant at the 0<>Z% level of confidence 






A PRELIMINARY REPORT ON PROJECT 17 
PART 1 1 s CONTR IBUT IONS OF FILM SUMMARIES TO 
LEARNING FROM INSTRUCTIONAL FILMS 
C« A» Norford 
STATEMENT OF THE PROBLEM 
Introduction 



This study parallels the first part of research 
project 17 which investigated the effects of film introductions 
on learning from lilms. It is an attempt to evaluate the 
effectiveness of the summary in some typical instructional 
films, and to suggest what functions the film summary might 
be expected to perform in order to improve the film as an 
instructional tool. 



Def init ion of Terms 

The term w Film Summary * 1 as used here, means a con- 
cluding sequence produced as an integral and purposeful 
part of the educational sound motion picture, which embraces 
one or more of the functions of review, recapitulation , 
statement of importance, and/or the issuing of a challenging 
note; it may also contain an w application” of the infor- 
mation, or contain new information not previously given in 
the film. 



The film summary is usually preceded by a fade in 
the visuals, and a natural break in the sound track, which 
separates it from the body of the film proper. It does not 
include THE END title. 



This investigation seeks answers to the following 
questions : 

(1) What functions can film summaries be 
expected to perform? 



most 



(Z) Which of these 
frequently by film summaries 



functions; are performed 
as currently produced? 



(3) What film techniques are used most 
frequently to present summaries? 



(4) What are the common practices in 
regard to length of film summaries in relation to the 
whole film? 



(5) Are typical films with summaries as now 
produced, more effective as instructional tools than they 
would be without the summaries? 



M •> 



o 
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PROCEDURE 



As a starting point a survey was made by questioning 
educators and psychologists, to determine the possible 
functions a film summary might be expected to fulfillo These 
may be classified under 6 main headings; 

(l) Rev iew - a mere topical outline of the 
film; a brief restatement of the organization of the film 
rather than of its informational content,, 

(£) Recap itulat ion - a brief repetition or 
restatement of the principal points in the film* 

(3) Importance - Stressing the value of the 
information in the film to the viewer personally,, 

(4) Challenging note - the issue of a chal- 
lenge to the viewer to apply the information in the film, 
or to seek further information, or undertake other acti- 
vities* This heading would also include the posing of 
questions for thought or discussion* 

(5) Appl icat ion - the illustration of a 
point of information by a concrete example* 

(6) New Information - the summary may con- 
tain information not previously given in the film, or it 
may relate the film to new material to follow* 

The film techniques used in the presentation of 
film summaries were also listed as follows: 

(I) Music - musical background behind com- 
mentary* 

( Z ) Animation - use of drawings and charts* 
etc* involving movement* 

(3) Narration - the off-stage voice of a 

narrator * 

(4) Lip-synch - a person on the screen speak- 
ing, with synchronous recording of the speech* 

(5) Live Action - simple movement as from real 

life* 

(6) S till shots - photographs or drawings 
without movement* 

(7) New Scenes - scenes not shown previously 

in the film* 

(8) Flash backs - the reshowing of parts of 
in the body of the film* 



scenes used 



(9) Quest ions - Asking questions, either by 
titles, or narration* 



Review of Film Summar ies 

A survey of 131 one-reel instructional films was 
made, and 87 which included summaries were analyzed in 
detail and classified according to function, f ilm t echniques 
used, and length of summary in relation to total length* 

This information is presented in Tables 1, Z, and 3* 



The F i 1ms Used in the Exper iment 

For use in the experiment to evaluate the effec- 
tiveness of the film summaries in some typical instructional 
films, the following films were selected; 

( 1 ) The Cell: Structural Unit _of Life 

(Z ) Magnetism 

(3 ) R ivers of the Pac if ic Slope 

These films appeared to contain examples of the 
best available summaries when considered in terms of current 
production practices* 

The characteristics of these films are given in 

Table 4. 
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TABLE li 

CHARACTERISTICS OF THE FILMS USED IN THE EXPERIMENT 



Total 
Title Film 


Length of 


Function of 


Film Technique 


Subject 


Length 


Summary 


Summary 


Used in Summary 


Type 



The Cell: 
Struc- 
tural 
Unit of 
Life 


370 ft, 1 min* 

10 min» l£ see® 
l£ sec* 12 0 2% 

of total 


Review 

Recapitulation 
Stresses Im- 
portance 
Challenging 
Note 

New Information 


Music 
Animation 
Narration 
Flashbacks 
Live Action 


General 
Science — 
Biology 


Magne- 


398 fto 1 min 0 


Review 


Music 


General 


tism 


11 min* E> sec 0 


Re c ap it ulat i on 


Narration 






k see*, 9oQ% 


Application 


Live Action 


Science- 




of total 


Stresses Im- 


lip Synch 


Basic 






portance 


New scenes 


Principles 






New Information 


Flash -backs 


of Magnetism 


Rivers 


38 7 ft 0 1 min a 


Review 


Music 


General 


of the 


10 min 0 2k sec„ 


Recapitulation 


Animation 


Science- 


Pacific 


Uf> sec* 13o0^ 


Application 


Commentary 




Slope 


of total 


Importance 


Live Action 


Geography 






Challenging 


Flash-backs 





Note 



For each of the three films, two experimental versions were , 
prepared* Io The complete film$ II „ The same film minus the summar; 
sequence only 0 The end title was retained in each version,, 



) 
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The Tests 



Tests were constructed which were based on the in- 
formation in the body of the film, and not on items appear- 
ing only in the summary,, Multiple-choice questions with 
four alternatives were used, together with a proportion of 
true-false questionso A pilot study was made to determine 
the validity of the three tests, and the tests were revised 
and proved for use in the final study,. 

The test on The Cell contained 58 questions, 11 
of which were true-f a lse % the test on Magnetism contained 
60 questions, eight of which were true-false$ and the test 
on Rivers o£ the Pacific Slope contained 5 2 questions, all 
of which were of the multiple-choice type 0 



Tes t Population 

Five hundred and sixty-one ninth grade students 
from three Pennsylvania high schools (Carlisle, Mechanics- 
burg and Hershey) were tested in this experimento Good 
cooperation by the schools made it possible to achieve a 
practical degree of randomizing by splitting the entire 
ninth grade population of each school into three experiment- 
al groupSo The same technique for randomizing used 'in 
Part I of this project, was also used here. 

As in the study of Film Introductions, one group 
acted as a control group snd took the test without seeing a 
film, while a second group saw the complete film (Version I) 
and the third group saw the film minus the summary (Ver- 
sion I!), 

The groups were rotated so that each group became 
a different experimental group for each of the three films. 
The rooms for film showings, and the t es t a dministrat 
were also rotated to distribute any differences which may 
have arisen from these variables. 

The test followed immediately on each film showing, 
and thirty minutes were allowed for its completion, A 
single forty-five minute period allowed sufficient time for 
showing the film and administering the test. 



SUMMARY OF RESULTS 

The question which this experiment sought to answer 
was i What effects did the summary sequences in these three 
films have on learning? 

The complete results will be given in the final 
technical report ° here only summarized test scores will 
be presented. 



* 
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TABLE 5 



SUMMARY OF TEST SCORES 
"THE CELL: STRUCTURAL UNIT OF LIFE" 





Control 

(fio U P i 1m ) 


E i lm minus 
Nummary 
Gr oup 


Complete 

Film 

Group 



Number of subjects 


192 


184 


185 


Mean Score 


24.67 


33.00 


33.57 


Standard Deviation 


5o65 


7.19 


8.52 


Standard Error 
of the Mean 


o41 


.53 


.63 




TABLE 6 






SUMMARY OF TEST 


SCORES 






"MAGNETISM" 








Control 
Group 
(No Film) 


Film minus 

Summary 

Group 


Complete 

Film 

Group 


Number of Subjects 


184 


185 


192 


Mean Score 


32o94 


37o00 


38.93 


Standard Deviation 


8 0 9S 


8 0 66 


8.57 


Standard Error 
of the Mean 


0 66 


o 64 


.62 



} 
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TABLE 7 



SUMMARY OF TEST SCORES 
"RIVERS OF THE PACIFIC SLOPE" 



3 







Control 
Group 
(No Film) 


Film minus 

Summary 

Group 


Complete 
F i lm 
Group 



Number of subjects 


185 


192 


184 


Mean Score 


»— * 
-vj 
o 

»— * 

o 


24.95 


ZboZ5 


Standard Deviation 


4<> 34 


6.86 


6 o 30 


Standard Error 








of the Mean 


.32 


,50 
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These results indicate that the groups which saw 
the films did definitely better on the tests than the control 
groups which did not see the filmso The differences were 
small between the groups which saw the complete f i lms , and 
those which s aw the f i lms minus the summar ies 0 For all three 
films the s umma r i e s ap^rently made small positive contribu- 
tions to learning* the differences in favor of the films with 
summaries being as follows* 

The Cell : Structura 1 Unit of Life / 0 573 

Magne t ism /l.92 * 

Rivers of the Pac if ic Slope / .30 

It shoul'' be noted that only one of these differences 
(For the f i lm Magnet ism ) reaches accepted levels of statisti- 
cal signif icanceo 



CONCLUSIONS 

The results suggest that these films* which includ- 
what seemed to be the best available summary sequences as 
produced today* are not materially better than they would be 
without the summar ies 0 

In view of the fact that a review or summary of a 
lesson is generally accepted as being beneficial to learning, 
it is reasonable to assume that better results should be ex- 
pected to accrue from film summarieso 

This suggests the urgent need for some experimental 
work on the problems of producing film summaries, based on 
established learning principles, which will be more effective 
aids to learning* than the film summaries which were tested 

# Significant at the 3 % level of confidence 




44 



rlsil 



in this, exper imento 

As a final comment it might be observed that the 
failure of the summaries to have any noticeable effect on 
learning in this experiment, could perhaps be a result of 
the fact that these f ilms are so tightly packed with fac- 
tual information (a 60 item test was constructed on each 
10 minute film with comparative ease) 0 Thus the level of 
learning was comparatively low, and it is possible that the 
summaries could add littleo 



/ 

i 





f 



45 



0 




A PRELIMINARY REPORT ON PROJECT NOo 24 
EFFECT OF REPETITIVE FILM 
PRESENTAT IONS ON LEARN ING 
Co Lo McTavish 
STATEMENT OF THE PROBLEM 

The repetitive showing of instructional films to 
increase learning is an accepted, although relatively un- 
tested, film utilization procedure 0 The purpose of this 
research study is to determine the increment in learning 
that may be attributed solely to one, two, and three re - 
petitions of the film, over and above a single presenta- 
tion 



EXPERIMENTAL DESIGN AND PROCEDURES 

Four films were shown to each of four groups of 
college students in such a way that each group saw one of 
the films once, a second film twice, a third film three 
times, and a fourth film four timeSo No two groups saw 
the same film the same number of timeSo 

The f i 1ms o The films used weres Atomic Energy , 
Electrochemistry , Colloids , and Food and Nutr it ion 0 All 
were 10 minute, sound, black-and-white. Encyclopaedia 
Britannica releaseso 

Five-choice objective-type tests were prepared for 
each film 



The population The experimental population in- 
cluded 31$ col lege freshmen enrolled in 12 sections of the 
science survey classes at the State Teachers College, West 
Chester, Pennsylvan ia 0 Of the 319, 99 were men and 220 
womeno 



Procedures o Two weeks before the scheduled film 
showings, the members of the experimental population were 
given a pretest covering all four films 0 This pretest was 
a scrambled form of the basic film tests 0 

For the film showings, the 12 sections were divid- 
ed into four groups® Each group was shown the four films, 
from one to four times according to the schedule in Table 1 0 
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TABLE 1 



NUMBER OF PRESENTATIONS OF EACH FILM 
TO EXPERIMENTAL GROUPS 



Group 


Atomic 

Energy 


Colloids 


Film 

Electro- 

Chemistry 


Food and 
Nutr it io 


I 


1 


Z 


3 


4 


II 


Z 


3 


4 


1 


III 


3 


4 


1 


Z 


IV 


4 


1 


2 


3 



The classes participating all met three times a 
week, on alternate days (Monday, Wednesday and Friday, or 
Tuesday, Thursday, and Saturday) 0 In each instance, the film 
was shown the required number of times in one class period, 
and the test on that film was administered at the next class 
per iodo 



RESULTS 

For a preliminary treatment of the data, the results 
for the four films were combined for each number of viewingso 
The scores for each film were converted to standard score 
form by taking them as deviates from the pretest mean of the 
whole sample (without respect to number of viewings ) 0 These 
scores were further converted into E-scores by mu 1 1 ip lying 
the standard scores by 10 and adding 50 o Finally, the pre- 
test and posttest S-score means were calculated for each 
film for each number of viewings, and the average mean for 
the four films was calculated for each number of viewingso 
Thus, the mean E-score for one showing is the sum of the 
mean E-score for the group seeing Atomic Energy once plus 
the group seeing Col lo ids once plus the group seeing 
Electrochemistry once, plus the group seeing Food and Nu - 
trition once, and divided by 4 

The posttest - pretest gains for each number of 
showings, and the differences in learning gains as the 
number of showings were increased, are reported in Table Z © 
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TABLE 2 



PRETEST AND POSTTEST CONVERTED (3-SCORE) MEANS AND MEAN GAINS 
ON COMBINED FILMS TEST, BY NUMBER OF SHOWINGS (N * 319) 



Number of Pretest Posttest^ Aretes? 1 in Gains; 

Showings Mean (fk (fdist Mean (fk (ylist Gains Increment 

From Added 

Showings 



Increment 
For Each 
Additional 
Showing 



1 

2 

3 

h 



5l*0 o& 9o3 
U9 o 6 ,57 iai 
U9*U *55 9o8 
50*Q .58 10.3 




1.2 

0.2 



35o0^ 
7o h% 
ld% 



* Significant at the 0.1# level of confidence 



CONCLUS IONS 

The following conclusions are justified; 

lo These films were effective in teaching at 
least some of the tested information. After one showing only, 
there was a 12-point gain over previous knowledge (in stand- 
ard scores). The pretest-posttest gain was significant at 
the 0.1 percent level of confidence. 

Zo Repeating the films resulted in greater 
learning. With every repetition there was a positive in- 
crement in the pretes t-posttest gain. However, the contribu- 
tion made by repetition of showings fell off rapidly after 
the first repetition. The first repetition resulted in a 
35# increment over no repetition, the second a 7.4$ incre- 
ment over the first, and the third only 1.1# over the second. 
Furthermore, only the increment attributable to the first 
repetition is statistically significant. 

The conclusion may be drawn that, for factual films- 
of the kind used in this study, showing them twice results 
in appreciably more learnings showings after the first 
two contribute little more to learning, and the drop-off is 
very rapid. 
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PRELIMINARY REPORT ON PROJECT NOo 32 
THE RELAT IVE CONTRIBUTIONS TO LEARNING OF 
VIDEO AND AUDIO ELEMENTS _IN FILMS 
Harold E 0 Nelson 
STATEMENT OF PROBLEM 

The main purpose of this study was to discover how 
well students will learn and recall what they see in a film 
as compared with that they hear 0 Other sub-compar isons were 
between the test scores made by students who heard the sound 
track of a film in the dark as against those who heard it in 
the lighto A further comparison was made between those who 
saw and heard a f i 1m which presented only the theory of the 
subject material and those who also saw and heard a second 
film showing these theories applied to problem situations.) 



PROCEDURE 

Two extant films were used* the one "Theory of 
Flight 11 and the other "Problems of Flight” A test contain- 
ing 65 items was constructed from both films 0 Some of the 
questions were verbal and others were pictorialo A group 
of judges made repeated viewings of the films and determined 
whether the answers to the particular test items were to b e 
found in the pictures, in the sound tracks, or in both., They 
also determined whether the answers were to be found in 
"Theory of Flight,” "Problems of Flight”, or in both filmso 

The subjects used in this experiment were 430 Re~ 
serve Officer Training Corps students at The Pennsylvania 
State College., These students were randomly divided into 
8 groups averaging about 54 to a groupo These 8 groups 
were subjected to various kinds of presentations of the film 
materials as shown below, and then tested with a multiple- 
choice testo Aeronautical instructors aided in the test con- 
struction,) The test was further validated by an item analysis.) 



TENTATIVE RESULTS 

All of the data have not been subjected to statisti- 
cal procedures as yet, so only mean scores for part of the 
results will be given in this report 0 
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TABLE 1 

FILM PRESENTATIONS GIVEN TO EACH 
GROUP AND SCORES EARNED BY EACH GROUP 



Theory of Flight Problems of Flight 

Group Video(sair) Audio(heard) Video(saw) Audio(heard) Mean Score* 



A (control No 
group) 


No 


No 


No 


28.9 


B Yes 


Yes 


No 


No 


37.7 



! C 


Yes 


Yes 


Yes 


Yes 


W*.9 


D 


Yes 


Yes 


Yes 


No 


39.5 


E 1 


Yes 


Yes 


No 


Yes 
(in dark) 


U2.5 


e 2 


Yes 


Yes 


No 


Ygg 

(in light) 


Uo,7 


F 


No 


Yes 


No 


Yes 


33.6 


Hi G 


Yes 


No 


Yes 


No 


37.8 



^Possible score, 6S> 



From the above results it appears that the films did 
contribute considerably to learning,. Group C which heard and 
saw both films did materially better than any of the other 
groupso All of the groups did much better than Group A which 
served as the control group and did not see or hear either 
f i lm<> 

Group B which saw and heard only the film ’’Theory 
of Flight” was outscored by grotips C, D, Ej an< ^ ^2 which were 
also exposed to various presentations of the film ’’Problems 
1 of Flights” This v/ould seem to indicate that it is better in 

a training film to show not only the theory, but also to 
apply this theory to concrete problems.. 

Group Ei earned a higher mean score than group Do 
!j'' Ei saw and heard ’’Theory of Flight” and only heard ’’Problems 

^ of Flight”® Group D heard and saw “Theory of Flight,” but 

only saw ”Problems of Flight”o 

The score for group E i is higher than that for E^o 
Both groups heard and saw ’’Theory of Flight,” but while El 
heard rhe sound track only of ’’Problems of Flight” in the 
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dark, E ? heard the sound track of "Problems of Flight in the 
1 igtit o ihe causes for this advantage of hear ing the sound 
track in the dark will be evaluated in the fuller report to 

follow. 



In the comparison between groups F and G it is noted 
that Group G received the higher mean score. Group G only 
saw both films and group F only heard both films. As the 
TTIms used in the testing are rather typical of training, 
films, in that much of the material to be taught is seeming- 
ly carried by the verbal portion, the advantage shown in the 
results for the pictorial portion might indicate that more 
emphasis should be given to the visual e lement of ^truct ion- 
al and informational films than is currently the practice. 
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